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Abstract 



We study a two-player zero-sum stochastic differential game with both play- 
ers adopting impulse controls, on a finite time horizon. The Hamilton- Jacobi- 
Bellman-Isaacs (HJBI) partial differential equation of the game turns out to 
tIh , be a double-obstacle quasi-variational inequality, therefore the two obstacles 

"j^ ■ are implicitly given. We prove that the upper and lower value functions coin- 

cide, indeed we show, by means of the dynamic programming principle for the 
stochastic differential game, that they are the unique viscosity solution to the 
HJBI equation, therefore proving that the game admits a value. 

(N 

^ . Keywords: Stochastic differential game, Impulse control, Quasi-variational in- 

' equality, Viscosity solution. 

l. Introduction 

The theory of two-player zero-sum differential games was pioneered by Isaacs 
[12] . Thanks to the mathematically rigorous definitions of upper and lower value 
functions for a differential game, see Elliott and Kalton [BJ, Evans and Souganidis [7] 
began to study differential games by means of the viscosity theory, characterizing the 
two value functions as the unique viscosity solutions to the corresponding Hamilton- 
r jJ] , Jacobi-Bellman-Isaacs partial differential equations (HJBI PDEs, for short). 

Inspired by the results achieved in the deterministic case, Fleming and Sougani- 
dis [5], for the first time, studied two-player zero-sum stochastic differential games 
using the viscosity theory. Adopting concepts presented in [BJ, they proved the dy- 
namic programming principle for the stochastic differential game and showed that the 
upper and lower value functions are the unique viscosity solutions to the second order 
HJBI partial differential equations, which coincide under the Isaacs condition. [5] is 
now considered a reference work in the field of stochastic differential games. More 
recently, the theory of backward stochastic differential equations has been success- 
fully applied to the study of stochastic differential games, firstly by Hamadene and 
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Lepeltier [TU] and Hamadene et al. [TT] . Subsequently, Buckdahn and Li [2] extended 
the findings presented in [1U| , , and generalized the framework introduced in [S] . 

The references mentioned above are focused on stochastic differential games with 
continuous controls. There exists also a large literature regarding Dynkin games, 
which are generalization of optimal stopping problems. Besides, the case with switch- 
ing controls has been recently addressed by Tang and Hou [19j . In the present paper 
we study a two-player zero-sum stochastic differential game with both players adopt- 
ing impulse controls, on a finite time horizon. In particular, we prove, using the 
dynamic programming principle, that the upper and lower value functions are the 
unique viscosity solution to the corresponding HJBI equation. To the author's knowl- 
edge, this kind of stochastic differential game has not yet been analyzed by means of 
the viscosity theory. As a matter of fact, only Zhang [22] studied, in the viscosity 
sense, a stochastic differential game involving impulse controls, but in |22| one player 
adopts impulse controls, while the second player uses continuous controls. 

Impulse control is a relevant topic in the field of stochastic control and a gen- 
eral reference is Bensoussan and Lions [T], where the focus is mainly on functional 
analysis methods. Instead, direct probabilistic methods are exploited in, for instance, 
Robin [T7] and Stettner [115]. Finally, concerning the study of impulse control prob- 
lems through the viscosity theory see, for example, Lenhart (TS], Tang and Yong [2D] 
and Kharroubi ct al. [T5] , 

During the past few years, the increasing demand for more realistic models in 
mathematical finance led to a renewed interest in impulse control. Indeed, impulse 
control may be particularly useful when dealing with, for instance, transaction costs 
and liquidity risk in financial markets. For more information on this subject see, for 
example, Korn [TJ, Ly Vath et al. [TB] and Bruder and Pham [3|. 

We give an outline of the problem. Let T > be the finite time horizon of the 
game, t £ [0, T] the initial time and x £ R™ the initial state. Then, the evolution of 
the state of the game is described by the following stochastic equation: 

X s =x+ j b{X r )dr + j a(X r )dW r + ^ U\ m ,T](s) Y[ 

for all s £ [t,T], P-a.s., with X t - = x. Here W is a d-dimensional Wiener process, 
while 

u ( s ) = ^ Cml[T m ,ri(g) and v(s) = ^7#l[ p ^ T ](s) 

are the impulse controls of player I and player II, respectively. The random variables 
£ m and r\i take values in two convex cones XL and V of R™, respectively, called the spaces 
of control actions. The infinite product Hf>i ^-{r m ^p e } nas the following meaning: 
When the two players act together on the system at the same time, then we take into 
account only the action of player II. We denote by X^ x ^ v = {Xl' x ' u ' v , t < s < T} 
the state trajectory of the game with initial time t, initial state x and impulse controls 
u and v. 

The gain functional for player I (resp., cost functional for player II) of the stochas- 
tic differential game is given by: 

J(t,X;U, V ) =E[ ^ f(Xl X ^')d S -J2 C ^n 1 U)Mr m ^T}\{Mr m ^ Pl } + 
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Whenever player I performs an action he/she pays a positive cost c, which results in a 
gain for player II. Analogously, x is the positive cost paid by player II to perform an 
impulse, which is a gain for player I. It is reasonable to impose the following condition 
on the cost function \: 

X(t, Zi + z 2 ) ^ x(t, z i) + X(t, z i) - h(t), 

for every t G [0, T] and z\,z 2 6 V. The presence of a strictly positive function h is 
required in the uniqueness proof for the HJBI equation. To guarantee uniqueness it 
is not enough to require the same condition on the other cost function c. We need to 
impose a stronger constraint that involves both cost functions, which is given by: 

c(t,y 1 + z + y 2 ) ^ c{t,yi) - x(t,z) + c(t,y 2 ) - h(t), 

for every yi, y 2 £ U and z G V. As a consequence, we have to require V C U. Finally, 
to prove the regularity with respect to time of the upper and lower value functions, we 
make the following assumption, introduced by Yong [3T] (see also Tang and Yong [20]), 
on the cost functions: 

c(t, y) ^ c(t, y) and x(t, z) ^ x(f, z), 

for every t < t < T, y £ U and z £ V. 

We define the upper and lower value functions using the Elliott-Kalton strategies 
as in [5]. We show that they are the unique viscosity solution of a HJBI partial 
differential equation, which results to be the same for the two value functions. This is 
a consequence of the assumption that the two players can not act simultaneously on 
the system. Therefore the uniqueness for the HJBI equation implies that the upper 
and lower value functions coincide and the game admits a value. 

The HJBI equation turns out to be a double-obstacle quasi- variational inequality, 
therefore the two obstacles are implicitly given and depend on the solution. This is 
a natural generalization of the result obtained in the context of Dynkin games, in 
which the HJBI equation is given by a double-obstacle variational inequality, see, for 
instance, Cvitanic and Karatzas [5] and Hamadene and Hassani [9]. Single-obstacle 
quasi- variational inequality has been considered recently by Kharroubi et al. [13] . by 
means of backward stochastic differential equations with constrained jumps. In the 
following paper, instead, we use the dynamic programming principle for the stochastic 
differential game to prove that the two value functions are viscosity solutions to the 
HJBI equation. 

The paper is organized as follows: Section [5] is devoted to fix the notations and 
to introduce rigorously the stochastic differential game. In Section [3] we study the 
regularity properties of the upper and lower value functions. In particular, we show 
that they are continuous on [0, T) x M" and bounded. In Section [5] we prove the 
dynamic programming principle for the stochastic differential game. Furthermore, we 
deduce some corollaries and generalizations, which turn out to be useful to prove that 
the two value functions are viscosity solutions to the HJBI equation. This latter is 
the subject of Section O where we give also the definition of viscosity solution for the 
HJBI equation via test functions and by means of jets, needed later in the proof of 
the uniqueness. Finally, in ScctionOwe prove the Comparison Theorem for the HJBI 
equation, therefore proving that the game admits a value. 
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2. The Stochastic Differential Game 



In the present section we introduce the model associated to a two-player zero-sum 
stochastic differential game (SDG, for short) involving impulse controls with finite 
horizon. 

Consider a complete probability space (f2, T , P) and a d-dimcnsional standard 
Wiener process W — (Wt)t^o defined on it. Let F = (!Ft)t^o be the natural filtration 
generated by the Wiener process, completed with the P-null sets of J- '. We are given 
two convex cones IX and V of W 1 , with Veil. We call XL and V the spaces of control 
actions. We begin by introducing the concept of impulse control. 

Definition 2.1. An impulse control u — Yl m >i £m-"-[r m ,T] for player I (resp., v = 
J2i>i Vi^-lpe.T] for player II) on [t,T] C K + = [0, +oo), is such that: 

(i) (r m ) m (resp., (pi)e), the action times, is a nondecreasing sequence ofF-stopping 
times, valued in [t, T] U {+00} . 

(ii) (£ m ) TO (resp., (r]e)i), the actions, is a sequence of XL-valued (resp., V -valued) 
random variables, where each £ m (resp., rji) is T Tm -measurable (resp., T Pt - 
measurable) . 

We denote by T > the horizon of the stochastic differential game. Let t G [0, T] 
be the initial time of the game and x G R n the initial state. Then, given the impulse 
controls u and v on [t,T], the state process of the stochastic differential game is 
defined as the solution to the following stochastic equation: 

X s = x+ f b(X r )dr + f a(X r )dW r + ^ £ ro l[ Tm , T ] (s) Y[ 1{W«}+ 



E 

£>1 



mMpe,T](s), (1) 



for all s e [t, T], P-a.s., with X t 



Remark 2.2. As mentioned before, the infinite product Hf>i -"-{T m #pt} m equation 
|T|) means that when the two players act together on the system, then we take into 
account only the action of player II. 

We make the following assumption on the functions b and a: 

(H 6)0 .) The functions b: R n -> K" and a: R n -> R nxd are Lipschitz continuous and 
bounded. 

Thanks to assumption (H^o-), there exists a unique solution X t - X ' u ' v = {X t s ' x ' u ' v , 
t ^ s ^ T} to equation JT]), for every (t, x) £ [0, T] x E™, u and v impulse controls on 
[t,T\. 

Definition 2.3. Let u = Yl m >i ^ml[r m ,r] be an impulse control on [t,T] and t ^ a 
two [t,T]-valued¥ -stopping times. Then we define the restriction Ur TlCr ] of the impulse 
control u by: 

U[t,*](s) = ^t.r(u)+ m ^{T fltT(tl) + m ^ < j}(s), T^S^a, 
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where /i tiT (u) is the number of impulses up to time r, i.e., 

Mt,r(u) := J2 Mr^r}- (2) 

For every (t, x) £ [0, T] x R™, u and u impulse controls on [t, T], we define the gain 
functional for player I (rcsp., cost functional for player II) as follows: 

J(t,x;u,v) :=E[ ^ /(X*™)ds - ^ c(r m , £™)l {rm< T} II 

+ X^^ w ' % ) 1 fw< T } +5(^t :C; "' 1 ') ■ ( 3 ) 

Remark 2.4. As mentioned in the introduction, the function c in Q is the cost 
function for player I and is a gain function for player II, meaning that when player I 
performs an action has to pay a cost, resulting in a gain for player II. Analogously, \ 
is the cost function for player II and is a gain function for player I. 

To guarantee a well defined gain functional we make the following assumptions on 
the functions /, <?, c, x an( i we introduce the concept of admissible impulse control. 

(Hf g) The running gain f : R ra — > R and the payoff g: M" — » R arc Lipschitz and 
bounded. 

(H CiX ) The cost functions c: [0, T] x U -> R and [0, T] x V -> R are l/2-H61der 
continuous in time, uniformly with respect to the other variable. Furthermore 

inf c > 0, inf y > 

[0,T]xU [0,T]xV 

and there exists a function ft,: [0, T] — > (0, oo) such that for all t £ [0, T] 

c(t, yi+z + y 2 )^ c(t, yi) - X (t, z) + c(t, ya) - ft(t) (4) 

and 

x(f, «i + z 2 ) < x (t, Zl ) + x (t, z a ) - (5) 
for every j/i,j/2 6 U and z,Zi,z% £ V. Moreover 

c{t,y)> c{i,y) and x(f, z) ^ x(i,z), (6) 

for every i,i e [0, T], with i ^ t, y £ U and z £ V. 

Definition 2.5. An admissible impulse control u for player I {resp., v for player II) 
on [t,T] C R + , is an impulse control for player I (resp., II) on [£, T] wfi/i a finite 
average number of impulses, i.e., 

E[/i tjT (u)] < oo (resp., E\p t ,T(v)] < oo), 

where ^, t ,T(u) is given by equation 0). The set of all admissible impulse controls for 
player I (resp., II) on [t,T] is denoted by Ut,T (resp., Vt,T)- We identify two impulse 
controls u = £ m s^ m^-[T m ,T] and u — X/m>i ^ m 

l[t m ,T] ^t,T, a^rf we write u = u 
on [t, T], if¥({u = u a.e. on [t, T]}) = 1. Similarly we interpret v = v on [t,T] in 

V t ,T. 
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Remark 2.6. Under assumptions (H;,^), (H/ jff ) and (H C:X ), the gain functional 
J(t,x;u,v), given by equation ((3]), is well defined, for every (t, x) € [0, T] x M", 
U € Ut t T and w € Vt,T- 

We may now define the lower value function V~ and the upper value function 
V + of the stochastic differential game. Before we need to introduce the concept of 
nonanticipative strategy. 

Definition 2.7. A nonanticipative strategy for player I on [t,T] C R + is a mapping 

a: Vt,T — > U t .T 

such that for any stopping time r: — > [f,T] and any v\, vi G Vt,T, with v\ = vi 
on Ji, r], it holds that a(v\) = a(v2) on [i, t]. Nonanticipative strategies for player 
II on [t, T], denoted by 

f3: Ut,T — > Vt,T, 

are defined similarly. The set of all nonanticipative strategies a (resp., f3) for player 
I (resp., II) on [t,T] is denoted by At,T (resp., Bt.r)- 

Hence, the two value functions arc given by: 

V~(t,x) := inf sup J(t,x;u, j3(u)) (7) 
@£Bt,T ueu t ,T 

and 

V + (t,x) :— sup inf J(t, x; a(v),v) (8) 

a£A t ,T "tVi-T 

for every (t,x) <E [0, T] x M". If V~ = V + we say that the game admits a value and 
V := = V + is called the value function of the game. 

The Hamilton- J acobi- Bellman- Isaacs equation associated to the stochastic differ- 
ential game, which turns out to be the same for the two value functions, because of 
the two players can not act simultaneously on the system, is given by: 

r r dV i 1 

max { min [ - — - CV - f, V - H c sup V\ , V - H? n{ Vj = 0, [0, T) x R", 

V(T,x)=g(x), Viel", 
where C is the second-order local operator 

CV = {b,V x V) + ±tr[o-o-'V 2 x V] 
and the nonlocal operators and "H^ lf are given by 

n c sup V (t, x) = sup [V(t, x + y)- c(t, y)] , Uf nf V(t, x) = inf [V(t, x + z) + X (t, z)] , 

y£U Z< ^ V 

for every (t,x) G [0, T] x R". 



3. Regularity of the Value Functions 

We prove that both the lower value function and the upper value function are 
Lipschitz with respect to the state variable, uniformly in time. Furthermore, they are 
Holder continuous with exponent 1/2 with respect to time on [0,T), uniformly in the 
state variable. Finally we show that the two value functions are bounded. 

We begin by proving the following lemma, which is concerned with the continuous 
dependence of X t ' x ' u ' v with respect to x. 
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Lemma 3.1. Under assumption (Hfj.o-) there exists a constant C > such that for 
every t £ [0, T], x, x € K™, u € Wt,T and v G Vt,T we have: 

E ^ x t,x;u,v _ x t,i;u,v^ ^ C \ x _ ^ 

for all s G [t, T] . 

Proof. We denote by X := X t > x > u > v and X := X 1 -^- 1 '. Then an application of Ito's 
formula gives 

\X S -X s \ 2 = \x-x\ 2 + 2 J (X r -X r ,b(X r ) - b(X r ))dr+ 

+ 2^ {X r - X r , (a(X r ) - a(X r ))dW r ) + J \a(X r ) - a(X r )\ 2 dr. 
Therefore, thanks to assumption (H^), there exists a constant L > such that 



E\\X S -X S \ 2 } < \x-x\ 2 + 



E[\X r - X r \ 2 ]dr. 



From Gronwall's lemma we deduce the thesis. □ 

In the following proposition, using Lemma l3.ll we prove that the lower and upper 
value functions are Lipschitz with respect to the state variable, together with the gain 
functional. 

Proposition 3.2. Under assumptions (Hf,.o-), (H/ )9 ) and (H CjX ), there exists a 
constant C > such that for every t G [0,T], x,x G R", u G lAt^T o,nd v G Vt,T we 
have: 

\J(t,x;u,v) - J(t,x;u,v)\ + \V~{t,x) - V~{t,£)\ + \V + (t,x) - V + (t,x)\ < C\x-&\. 

Proof. It is enough to show that the conclusion holds true for the gain functional J. 
Let us denote by X := X t > x '< u > v and X := X f ^ u ' v , then 

\J(t, x- u, v) - J(t, x; u t v)\^E[J \f(X s ) - f(X s )\ds + \g(X T ) - g(X T )\ 
Thanks to assumption (H/, s ) there exists a constant L > such that 

\J(t,x;u,v) - J(t,x;u,v)\ < L J E[\X S - X s \]ds + LE[\X T - X T \]. 

From Lemma 13711 we get the thesis. □ 

Now we prove the regularity condition of the value functions with respect to time 
and we need the following lemma. 

Lemma 3.3. Under assumptions (Hi^), (H/ )9 ) and (H CjX ) the lower and upper 
value functions are given by: 

V~(t,x)= inf sup J(t,x;u, f3(u)) 
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and 

V + (t,x) = sup inf J(t, x; a(v),v), 

for every (t,x) G [0, T) x W 1 , where Ut,T and Vt,T contain all the impulse controls 
in Ut,T and Vt,T, respectively, which have no impulses at time t. Similarly, At,T and 
Bt t T are subsets of At.T and Bt,T, respectively. In particular, they contain all the 
nonanticipative strategies with values in Utj- and Vt,T, respectively. 

Proof. Let e > 0, u G Ut,T\<Ut,T and P G Bt,T\Bt,T- We have to prove that there exist 
u G Ut,r and (3 G Bt,T such that 

\J(t, x; u, f3(u)) — J(t, x; u, $~(u))\ < e. 

Let v := P(u) G Vt,T and /3(u) = v G Vt,T, for every u G Ut.T- Then, given u G 
Ut,T\Ut,T and ?; G V^t, we have to prove that there exist u G Wt.T and v G Vt,r such 
that 

| J(t, x; u, v) — J(t, x; u,v)\ ^ e. 

We may suppose v G Vt^T\^t,T, in the other case the proof is simpler and we omit it. 

We start by considering the case in which u and v have only a single impulse at 
time t. As a consequence, there exist two [£, T]-valucd F-stopping times r and p, with 
P(t = i) > and ¥{p = t)>0, such that 

u = ^l[ TiT ]+u and w = ??l[p,T] + 

where u = J2 m ^i £ml|V mi T] € ^[t,T], # = X^i^Im.T] € %,t], £ is an J" T - 
measurable U- valued random variable and rj is an J-" p -measurable V-valued random 
variable. 

For every integer n l/C? 1 — i), we introduce the following F-stopping times: 
T n = (t + i)l{ T =t} + t1{ t>4 } and p„ = (p + i) l {(3=t} + pl{ p>t }. 
Define the admissible impulse controls: 

u„ = £l[ Tn ,T] + u and w„ = ?7l[ P „,T] + v. 
Note that u„ G Uy t .T\ and u„ G V[t tj. Then we have: 

J(t, x- u, v) ~ J(t, x;u n ,v n )=E[ ^ (f(X$*w) _ /(X^^><"*))ds 

- C ( r m:£m)l{T m <T} II l{r m #p t .}( 1 {r m #p} ~ l{r m #p„}) 

- c(t,^)1 {tsST} J| l{ T ^p,}l{ T ^p} + c(T„,^)l {Tn ^ T} l{ Tn ^ pe }l{ Tn ^ Pn } + 

+ x(p,v)~k{p^T} ~ xOn,J7)l{p„cr} + .g(A^ ;u/u ) -g(xjf ;u "' t '™) . 

Now we observe that r„ — > r and p n — > p, as n tends to infinity, P-a.s.. Moreover, 
Vs G {t,T], Xl' x ' Un ' Vn -> Xl' x ' u ' v , as n tends to infinity, P-a.s.. Therefore, from the 
Dominated Convergence Theorem, we deduce the existence of an integer N ^ 1 such 
that 

\J(t, x; u, v) — J(t, x; u n ,V n )\ ^ e, Vn ^ N. 
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Finally, we have to consider the case in which u or v or both have multiple impulses 
at time t. However it is simple to show, using conditions ^ and (O, that we can 
reduce this case to the previous one with only a single impulse at time t. □ 

Proposition 3.4. Under assumptions (Hj,.,,), (H/ )S ) and (H c . x ), there exists a 
constant C > such that: 

\V-(t,x)-V-(t,x)\ + \V + (t,x)-V+(t,x)\ < <7|t-£|*, 

for every t, i £ [0, T), x £ M". 

Remark 3.5. Observe that the restriction of the lower value function to [0, T) x R" 
admits an extension to [0, T] x K n , l/2-H61der continuous in time and Lipschitz 
continuous in the state variable, which in general does not coincide with the value 
function itself at the horizon time T. An analogous remark applies to the upper value 
function V + . 

Proof. We make the proof only for the lower value function V~ , the other case being 
analogous. Let t £ [t, T], then for every e > 0, thanks to Lemma [3.31 there exist 
u £ £ Ut,T and (3 £ £ Bi T such that 

V~(t,x) - V~(t,x) < J(t,x;u s ,j3 e {u e )) - J(t,x;u e , p e (& e )) +e, 

where u £ £ U- t T and j3 e £ Bt.r will be chooscn later. In particular, suppose that 
u £ = Y^, m >i ?m.l[T^,T] G Ut,T, then define it £ as follows: 

Thus ii £ is nothing but the impulse control obtained from u £ by moving all the im- 
pulses in the time interval [t,t\ to the instant i. Now define $ £ (u) = j3 £ {u £ ) =: v £ £ 
Vt.T, for every u £ Ut^r- Then we have: 

V~(t,x) - V~(i,x) < J(t,x;u £7 v £ ) - J(i,x;u e ,v e ) +e. (10) 

Using conditions (0| and §6§ we find 

if there is at least one impulse in the time interval [t,t\. Therefore 

J(t,x;u s ,v e )-J(t,x;u e ,v e )^E\[ /(X*^**)ds- / f(X { s < x > {i *< v *)ds+ 



We note that, thanks to assumption (Hb j(X ), there exists a constant Ci > such that 

for all s £ [t, T]. Therefore we find, using also the boundedness of /, that there exists 
a constant C% > such that 

J(t,x; U e , V e ) — J{t,X\U e ,V B ) < C 2 \t - t\% . 
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Hence 

V-(t,x)-V-(t,x) < C 2 \t-t\i. 
In a similar way we can prove that there exists a constant C3 > such that 

V-(t,x)-V-(ix) > -C 3 \t-t\i, 

from which we deduce the thesis. □ 

Finally, in the following proposition, we prove that the two value functions are 
bounded. 

Proposition 3.6. Under assumptions (Hf, j(T ), (H/ >3 ) and (H C:X ), the lower and 
upper value functions are bounded. 

Proof. We make the proof for the lower value function, the other case being analogous. 
Let e > 0, then, using the definition of lower value function, equation ([7]), we have, 
for (t,x) e [0,T] x W\ 

V~(t,x)= inf sup E[ [ T f(Xl' x ' u ^)ds + g(X^ uMu) )+ 

i3EBt,T u£U t ,T l Jt 



(«)} 



£>1 



£>1 



> E 



- £ > E 



/(lsi .; UDA (u o))ds + s(1 M; UD;W «o) )+ ^ x(ft£(llo)jI? e (uo))1{ ^ ii(|KT) 



for some /3 £ (uo) = ( M o)l[p|(ti ),71 G V^t, where uq S W 4: t is the control with 

no impulses. Since / and g are bounded we deduce that V~ is bounded from below. 
In a similar way, we can prove that V~ is also bounded from above. □ 



4. Dynamic Programming Principle 

We now present the dynamic programming principle (DPP) for the stochastic 
differential game. 

Theorem 4.1. Under assumptions (H(, j(T ), (Hy. g ) and (H c . x ), given ^ t ^ s < T 
and x € R™, we have: 

V-(t,x):= inf sup e\ f /(j£*^M)dr + $>(«(«), *Ji(u))l{ w („)<.} 

^c(r m ^ m )l {rm ^n i ^P f («)}+^( s ^'' :!;; " ,/3(u) )l (11) 



£>1 



y (t, a;) := sup inf 



/(X t,*;<*M,» )dr + £ xfo. %)1{p,<s} (12) 
E c(r m («)^ m («))l {Tm(wKa} J] + V+{s,Xl^) n 



£>1 
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Proof. We prove the dynamic programming principle only for V~~ , the other case 
being analogous. Let u £ Ut,T and e > 0, then there exists a strategy /3 1,6 £ Bt,T 
such that 



inf sup E / /(X^^)dr- ^c(r m ,C m )l {Tm ^ } n i {^^(«)}+ ( 13 ) 

- ^ c(T m ,^ m )l {Tm0} II 1 ^^^)} +H X ^ 1 ' £ ( M )' 7 '^ £ ( U )) 1 {p f 1 ' e (u)=S4 + 
m^l £>1 £^1 

+ F-(s ! X*' x;u ^ 1 ' e W)] 



— e. 



Now, from the regularity of V and J with respect to the state variable, see Propo- 
sition [XH we deduce the existence of a strategy /3 2-e £ B s ,t such that 

Efy-^X^ 1 ^)] >E[j( a ,X 8 t ^ 1 "W;« [ .,r, J ^ e (tt [a , : ri))] -e, (14) 

where U\ s< t] is introduced in Definition 12.31 Indeed, let be a partition of R™ 

such that, thanks to the regularity of V~ and J, given Xi £ Aj, then for all y £ A, 
we have 

J{s,x i ;U[ St T],v) > J(s,y;u[ SjT ],w) - |e and y _ (s,y) ^ V _ (s,Xi) - |e, 

for every w £ V s .t- Moreover, thanks to Lemma 13.31 for every Ai there exists a 
strategy /3 Ai £ B Sj t such that 

^"(s,^) ^ J(s,x i ;M [S:T] ,^ j4l (u [SjT] )) - ±£. 

As a consequence, for every y £ Ai the following inequality holds: 

V'(s,y) > J(s,y;M[ s ,T],/? A *( M [^T])) - £• 
Therefore, in our case, we have 



3 



3* E [ £ ; ^,r] , P A ' (u [s , T] )) U 

i>l 



— £ 



3 



-t-oo 



£. 



We introduce the strategy /3 2,e G Z? Sj t given by 

+ oo 



This means that 
r)f e (u)l, 2,e (u) T] is given by 



P 2 ^{u) := IaAXT'^ * {u) )P Ai {u [s>T] ). 

i=l 

if P a% {u[s.t]) = T,e>ivt i ( u [s, , r\) 1 [pti( Ul . iT] ),T\> then £ 2,e («) = E^l 



i=i 
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and 

+00 

V f%u) := £ lA4Xr^ {u) )vf(u ls , T] )- 

i=l 

Finally, we define a new strategy /3 e € Bt,r, equal to fi 1 ^ up to time s and to /3 2 ' e 
from time s to T. More precisely, the definition of (3 £ is as follows: Let j3 ,£ (u) = 
Eoi r ?l' £ ( u ) 1 [^' s («)>r]' ^'"H = T,e>ivf £ {u)l [p 2,. {u)T] and /3 e (u) = £ 01 ?7f(u) 
1[p|(«),t], then 



pf (u) := P/ 6 (tt)l{<< WiS p>,=(,))} + ^ M (/ ) i, t („))(' i )l{(>/ li , J ((J 1 .1«))} 

and 

?7|(u) := %' e (w)l{^< Mt , s (^i.= («))} +^f Mti8 ( 1 ai, £ („))( u ) 1 {^>/ it ,«(/3i.= («))}, 
where (Xt,s{P 1,e {u)) is given by equation Therefore, from (|13J) and (|14|) we get 

E 



+ E x(p] ,8 («), ti e (u))i {pr(uHs} + v-( S , xr^ c ^)\ 

* m^l £^1 

+ ^x(rf1«) I % 1 1«))i { , ; , w , s} + J(a^ I; " /,e( " ) ;« [s ,T],/? 2 ' £ W) 



-2e = J(t,x;u 7 /3 e (u)) - 2s. 
We can now easily deduce that the following inequality holds: 

r-(t,aO < inf sup E[ [ S f(X t r > x > u ^)dr + V % (u))l {w( „ Ks} 
peB t ,T U (zu t ,T l Jt J^l 

In a similar way we can prove the reverse inequality, hence deducing the thesis. □ 

Now we prove the following corollary of the dynamic programming principle, which 
is concerned with the DPP for s = t. In particular, we prove that we can neglect 
multiple impulses, thanks to conditions @ and (O. Corollary 14.21 will be useful to 
prove that the two value functions are viscosity solutions to the HJBI equation. 

Corollary 4.2. Under assumptions (Hf,.^), (H/, g ) and (H CiX ), given (t,x) € [0,T)x 
W l , we have: 

V~(t,x) = inf sup E - c(t,£)l{ T=t }l {p=+00 } + 

+ X(t )? 7)l {p=t} +F-(t ) Xf ia ^''' 1 ^>) 

where Tt,+oo is the set of ¥ -stopping times with values in {t, +00}. An analogous 
statement holds for the upper value function V + . 



12 



Proof. We make the proof only for V , the other case being analogous. Consider the 
dynamic programming principle for V~ with s = t: 

V~(t,x) := inf sup E - c(t,£ rn )l {Tm=t} TT t{ Tmjtpe ( u )} 



+ ^ X (t, % ( U ))i {w(u)=t} + (t, x^M) 

Let p S 7t,+oo and 77 £ then consider the strategy f3(u) = r/l[ pT ^ for every 
u 6 Wt.T- Now fix m = Em^i^">"[rm,T] ^t,T an d define the impulse control 
u = ^lr Ti r], where £ and r are given by: 

£ = ]T UMr m =t}, T = t(l - [J l {Tm>t} ) + (+0O) l {Tm>t} . 

Then r e 7^,+oc and £ € TV- Moreover X*' a:i "^ ( " ) = X^ 1 ^ 1 '" 1 ^ 1 , P-a.s.. There- 
fore, using condition l[4"]). we find 

E [- E c(Um)l{T m = t }l{,=+oo}+XM)l0,= t } +y-(t,X'' X;ti '' 7l[ '" TI 

< e[ - C (t, oi { r=t}i{^oo } + x(*. v)M P = t} + v- (t, x*** 1 ™ ) 

As a consequence we have 

V~(t,x)^ inf sup E - c(i,£)l {T=t} l {p=+oo} + 

+x(^)i { ,= t} + r(i,if ia ^"' 1 ^) 

In a similar way we can prove the reverse inequality, therefore deducing the thesis. □ 

To prove that the value functions are viscosity solutions to the HJBI equation, 
we need the dynamic programming principle also for stopping times which assume 
a countable number of values. This result is a simple extension of the dynamic 
programming principle for deterministic times and it is presented in the following 
lemma. 

Lemma 4.3. Under assumptions (H&.o-), (Hy. g ) and (H CiX ), given t ^ s < T, 
x £ R™ and a [t, s]-valued ¥ -stopping time r, which assumes a countable number of 
values, we have: 

V~(t,x) := inf sup e[ f /(X^^dr + %(«))l {A< (« K r} 
An analogous statement holds for the upper value function V + . 

Proof. Let r = J^j^i^j^-B^ with tj € [i, s] and Bj G J 7 ^. The proof is completely 
similar to the proof of the dynamic programming principle for deterministic times 
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(Theorem 14. Therefore we focus only on the main point, that corresponds to 
inequality (|14p . which now becomes: 



E 



[V- (t, X^'^M )] = E [ V- (r, x t T x ^ f)1 ''^)l B] 



3>1 



= E[j(r, X*^ 1,S W; U[T , T] , ^ /3 2 <^ ( U )1 B . 



3>1 

where /3 2 ' £J G ^.r, for every j ^ 1. We define the strategy /3 2,e := Ylj>i P 2,e '^B 3 
and we conclude as in the proof of Theorem 14.11 □ 

We end this section with a technical lemma, which will be useful to prove that the 
two value functions satisfy, in the viscosity sense, the terminal condition to the HJBI 
equation. 

Lemma 4.4. Suppose that assumptions (Hb, CT ), (H/, s ) and (H CjX ) hold true, then 
for every (t, x) G [0, T) x M. n we have 



V~{t,x)= inf sup E 



( ~ c(£,£) ]I {T=i,p=+o } + 



(15) 



x(t,v)M P = t} + v-(t,xr^^))(i i {r=+oc , p=+oo} )+ 

T 

t,x;u a ,v a y 



f(X*''^)dr + g(X^ 



) l{r= 



+oo,p— +00} 



where uq and vq are the controls with no impulses. An analogous statement holds true 
for the upper value function V + . 

Proof. We make the proof only for V~ , the other case being analogous. Let r G Tt. +oc, 
£ € T T and e > 0, then there exist p 1 ' 5 G Tt,+oo and 77 1 ' 6 G -T-pi.e, such that the right 
hand side of equation (|15[) is greater than or equal to the following expression: 



(-c(t ) e)i {r = t ,, I , £ = +00} + ^-(t,^' x;ei[T * T1, ' ?1 ' sllpl ^ TI )+ 



(16) 



\(t, r7 1,£ )l{pl, e=t } ) (l - l{ r =+oo,pi'»=+oo} 



}) + ([ f(X t r ' x -> U0 > v °)dr+ 



t.x;uo,VQ ' 



) l{r= 



: + 00,p 1,£ — + 00} 



Now fix u G Ut^T, then, proceeding as in the proof of the dynamic programming 
principle (Theorem 14. ip . thanks to the regularity of V~ and J with respect to the 
state variable, we deduce the existence of a strategy /3 2,6 G Bt.r such that 

Finally, we define the control u G Ut.r and the strategy f3 £ G £>t.T as follows: 

U = [(£l{r=t} + "ol{r=+oo})lt + #](! — l{r=+oo,p 1 . E =+oo} ) + «0 l{r=+oo,p 1 >« =+00} 
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and 



P £ {u) = [(tJ U l {p i, e=f} + Udl^i^+oo}) 1* + P 2 ' e {u)} (1 - l{ T =+oo lP i.«=+oo}) + 
+ ^ol{r=+oo,p 1 ' e =+oo}i 



for every u G lAt.T- Therefore, from we find 

■ c(t,£)l {T=tiP=+00 } + 
+ x(t,v)i {P =t } + v-^xf^ 1 ^ 1 ^)) (1 - 1 {T=+00 , P=+0C} )+ 



inf sup E 



/(X^>"°)dr + 5 (X^ ; "°'" ))l {T = 



-+oo,p— +00} 



from which we deduce that the following inequality holds: 



^ J(t,x;u,/3 £ {u)) - 2e, 



inf sup E ( - c(^,^;):IL{ r=tIP=+00 } + 

peTt, += o,r ) e.F p re7 - t !+00 ,j e ^v L\ 

+ X (i,77)i {p=t} + y-(t, x^ 11 ^^ 1 ^ 1 )) (1 - i {T=+co . p=+oc} )+ 

+ (^ T /(^"«^)dr + 5 (X^ ^))l {T=+OO!P=+oo} ] > V-(t,x). 
In a similar way we can prove the reverse inequality and thus we get the thesis. □ 



5. Hamilton- Jacobi-Bellman-Isaacs Equation 

In the present section we give the definition of viscosity solution to the HJBI 
equation §§§ and we prove that the two value functions are viscosity solutions to this 
equation. 

Definition 5.1. A lower (resp., upper) semicontinuous function V : [0, T] x R" — > R 
is called a viscosity supersolution (resp., subsolution) to the HJBI equation (QJ) if 

(i) for every (t, x) G [0, T) x R" and <p G C 1 ' 2 ([0, T) x R"), suc/i i/iai (i, x) is a /oca/ 
minimum (resp., maximum) ofV — tp, we have 



I 



max < mm 



~dt 



{t, x) - £<p{t, x) - f(x),V(t, x) - H c sup V(t, x) 



(17) 



V(t, x) - Uf nt V(t, a?)} > (resp., < 0). 



(ii) /or every x G 1™ we have 

{ mm [V(T, x) - g(x), V(T, x) - H c sup V(T, x) 



max ■ 



(18) 



V(T, x) - nf nf V(T, x)\ > (resp., 0). 



^4 locally bounded function V : [0, T) x R™ — > R is a viscosity solution to the HJBI 
equation ^ if its lower semicontinuous envelope V* is a viscosity supersolution and 
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its upper semicontinuous envelope V* is a viscosity subsolution. V* and V* are given 
by: 



V*{t,x):= liminf V(s,y), 

(s,y)^(t,x),s<T 

for every (t,x) G [0, T] x R". 



V*(i, x) := limsup V(s,y), 
(s,y)-y(t,x),s<T 



Remark 5.2. The lower and upper semicontinuous envelopes of the restriction of V~ 
to [0, T) x W 1 coincide on [0, T] x R n and are equal to the (l/2-H61der continuous in 
time and Lipschitz continuous in the state variable) extension of V~ , see Remark 13.51 
An analogous remark applies to the upper value function V + . 

To prove that the two value functions are viscosity solution to the HJBI equa- 
tion ([2]), we begin with the following lemma. 

Lemma 5.3. Under assumptions (Hj, )ff ), (Hy )S ) and (H CiX ) 7 the lower and upper 
value functions satisfy the following equation: 



max 



0, 



{ min [0, V(t, x) - n c sup V(t, x)] , V(t, x) - H? ni V(t, x)} 
for all t e [0,T) and i £ I". 

Proof. We prove the lemma only for V~ , since the proof for V + is analogous. When 
s = t in the dynamic programming principle for V~ , we have, thanks to Corollary 



V (t, x) = inf sup E 



- c(t,£)l{T=t}l{ P =+oo}- 



+ X (t,n)l {p=t} +V-(t,X t 



*,2i;?l[T,T],?)l[p,T] 



Note that xl' x ^ llT ' T] ' vllp ' T] = x + £l{ T=t }l{ p=+00 } + ijt{ p=t }, P-a.s.. It is simple to 
show that to attain the optimum we need to consider only deterministic quadruples: 
(p, z, t, y) G {t, +00} x V x {t, +00} x II. Consequently we have: 



V (t, x) = inf sup 



I - c{t,y)l {T=t} l {p=+oo} + 

+ X ( t , Z ) i {p=t} + v- (t,xr^ ^ ) } . 

Therefore, rearranging the terms, the above equation can be written as follows: 
inf f \v-(t,x)- (V-(t,x + y)-c(t,y))]l {T=tiP=+oo} + 

V-(t,x)-(V-(t,x + z)+x(t,z))\l {p= t } } =0. 



sup 

pe{t, +00}, zev 



We can write this as 



sup f min {(V (t,x)-H c V (t, x)) l {r=t , p=+oo} }- 
V- (t, x) - (V- (t, x + z) + X (t, *))] l {p=t} } = 0, 
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which becomes 



c | min 



pe{t, +00} 



0, V- (t, x) - H c sup V- (t, x)\ l {p=+oo} + 



+ [V-(t,x)-H* nl V-(t,x) 
Now we can easily derive the thesis. 



l{ p=t } 



□ 



Remark 5.4. From Lemma [Owe deduce that V~ Hf ni V- on [0,T) x 1™. More- 
over, when V - < Uf nl V~, then 7^ up V _ < V~ and "H s c up y~ < 'Hf nf V r -. Therefore, 
we can interpret T-ls Up V~ as a lower obstacle and Hf nf V~ as an upper obstacle. They 
are implicit obstacles, in the sense that they depend on V~ . Clearly the same remark 
applies to V + . 

Now we prove that the two value functions satisfy, in the viscosity sense, the 
terminal condition. 

Lemma 5.5. Under assumptions (Ht, j(T ), (H/ 9 ) and (H CiX ), the lower and upper 
value junctions are viscosity solutions to 1181) . 

Proof. We make the proof only for V~ , the other case being analogous. Firstly, we 
prove the supersolution property. We have to prove that, for every x £ R n , the 
following inequality holds: 



max < mm 



V- (T, x) - g(x), V- (T, x) ~ H c sup V~ (T, x)\ , 

V-(T,x)-H? ai V-(T,x)} >0. 



(19) 



Thanks to Lemma POl and the fact that V and V„ coincide on [0, T) x R ra , we have 
for every t G [0,T): 



K (i, a;) = inf sup E 

p£%,+oa,v£Fp re7t, + oo,C6^t 



f - c(i,£)l {r=tj p =+oo} +x(^,??)l{p=t} + 

KT (t, jtf** 1 ™ '" lfP ' T1 )) (1 - l { r= + oo,p= + =o}) + 



/(X* ,x;Mo ' t ' cl )dr + ^(Xy 21 ' 110 '" 



1{t— +oo,p— +00} 



Thanks to the boundedness of / we find (in the sequel the letter C stands for a 
positive constant, independent of t, whose value may change from line to line): 



f{Xl^ U0 ' V0 )Ar <C(T-t). 



Furthermore, using the Lipschitzianity of g and the fact that uq and vq are the control 
with no impulses, we deduce the following standard result: 

E[U(^*~) - g(x)\] < C(l + \x\)\T -t\i. 



As a consequence we get: 

{t, x) ^ inf sup 1 
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+ v-{t,xr^ Thni{p ' n )) (i - i { .= + oo,p= + oc } )+ 

+ . 9 (.x)l {T=+cc , p=+oo} ] -C(l + \x\)\T-t\i. 

Now, proceeding as in the proof of Lcmma [5.3l wc end up with the following inequality: 

max {min V~ (t, x) - g(x), V~(t, x) - H^ up V~ (t, x) , 

V-(t,x)-H? f V-(t,x)} > -C(l + |a:|)|r-i|i. 

Using the l/2-H61der continuity in time of V~, c and Xi uniformly in the other 
variable, we deduce that also the left-hand side is l/2-H61dcr continuous in time, 
uniformly with respect to x. Therefore we have: 

max { min [v~ (T, x) - g(x), V~ (T, x) - H c sup V~ (T, x)] , V~ (T, x) - Hf nl V~ (T, x)] + 

+ C\T - t\ * ^ max { min [y~ (t, x) - g(x), V~ (t, a:) - H c sup V~ (t, x)j , 

V-(t,x)-H? ni V-(t,x)}. 

Hence we see that ([T§]) holds. In an analogous manner we can prove the subsolution 
property □ 

Now we are ready to state one of our main results. 

Theorem 5.6. Under assumptions (H^.o-), (Hj !9 ) and (H cx ), the lower and upper 
value functions are viscosity solutions to the HJBI equation flj). 

Proof. We give the proof for the lower value function V~ , the other case being anal- 
ogous. Thanks to Lemma 15.51 we have that V~ satisfies in the viscosity sense the 
terminal condition. As a consequence, we only have to address (jTTJ) . 

We know from Proposition 13.21 and Proposition 13.41 that V~ is continuous on 
[0, T) x R", therefore V~ is equal to its lower semicontinuous envelope and to its 
upper semicontinuous envelope on [0, T) x R™. We begin by proving that V~ is 
a viscosity supersolution. Thanks to Lemma 15.31 it is enough to show that given 
(t Q , x ) G [0, T) x E n such that 



V-(to,xo) -n c sup v-(t ,x Q ) > 



and 



V-(t ,x )-U? a{ V-(to,x ) <0, 



then for every (f E C 1,2 ([0, T) x M. n ), such that (to, xq) is a local minimum of V 
we have 

dip 

We may assume, without loss of generality, that 

V~(t ,x a ) = ip(t ,x ). 

Let A > be such that 

X + V-(t ,x ) =U? n{ V-(t ,x ) = irf(V-(t ,x + z) + x(to,z)). 

From the regularity of V~ we have (in the sequel the letter C stands for a positive 
constant, whose value may change from line to line) 

E[\V-(s,Xl°>*°) - V-(to,xo)\] < C\s - to\i, 
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with X* ^ = xl ' Xo ' u °' Vo , for all s e [t ,T], P-a.s., where u and w are the controls 
with no impulses. Analogously, thanks to the l/2-H61dcr continuity of \ with respect 
to time, uniformly with respect to the other variable, we have that |x(s, z)—x{to, z)\ 
C\s - t \ 1/2 . Therefore, for every random variable 77, ^-measurable and assuming 
values in V, we find: 

E[V-(s,Xi a > x °)} ^ ElV-(s,Xl<»*° + X (s, v)} +C\a-to\i-X. (20) 

Now, for every e > 0, using the dynamic programming principle for V~ , Lemma 14.31 
with s £ [toj^ 1 ) and t a [to, s]-valued F-stopping time, which assumes a countable 
number of values, we have 



<p(to,xo) = V-(to,xo)= inf sup E / /(X*>™«.*<0)dr + V~(t, 



In 



for some /3 e G S* ,T, with /3 £ (u ) =: V E = T it^-\p',T] S Vt ,r- Our goal is to show 
that the following inequality holds true: 



<p[to,x )>E / /(X*«^)dr + y-(r,X* ^) 



(21) 



if we take s sufficiently small. We exploit (|2TJ|) to derive (|2ip . 
Remember that the following identity holds: 

IHo.t^s) 

where is given by equation l[2"]). Now, using the boundedncss of 6 and er, we get 



E 



Furthermore, using (J5]), © and ([2TJ]) we find 



£=1 



^ E 



£=1 



Pt ,r(v e ) 



V-(T,X t T ^ X0 + It) -^"(r,X* ' X0 ) + F-(T,X*°' X0 ) ^E[F-(r,X*°' X0 )+ 



+ (A-C|a-t |')l {Mto , T («.)>i}]- 
Hence 



pfo.aro) >e[ / /(^^^^)dr+F-(T,X*°^) + (A-C| S -io| = )l { ^ otTK)>1} 



— e. 
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Using the boundedness of / we deduce 

<p(to,x ) > E[ ^ /(X^dr + V-(t,X^) + (A - C\s - i„|i 
l Jt 

- C\s - *o|)l{ Mto , T (tO>i} 

Therefore there exists s £ (to,T) such that for s£ [to, s] we have 

\-C\s-t \* -O\s-t \ ^ 0. 

Consequently, for every [to, s ]-valued F-stopping time r, which assumes a countable 
number of values, we deduce that inequality (f2~Tj) holds. 

Since (to,xo) is a local minimum of V~ — ip, there exists 5 > such that 

V~(t,x) ^ ^(t,a;), |* — t | < $, \x-x \ < (5. 

Moreover there exists a positive constant C such that, for every t £ [to, T), we have 

n\X^ X0 -xo\}^C\t~t \i. 

Consequently there exists a sequence t n \. to such that Xl°' x ° — > xq, P-a.s., as n tends 
to infinity. We may assume that t n ^ s, for every n 1. Now define the following 
sets -B n C f2: 

B„ = {|X*°' Xo - x [ < <5, Vm ^ n}. 

Then £?„ f B := U n ^iB„, with P(B) = 1. Furthermore, for every m ^ 1, let introduce 
the stopping time 



+ml{B n \S n _ 1 }i 



where Bo is the empty set. Then r m \. to, P-a.s., moreover r m ^ t rn . Inserting r m in 
HI), we find 



<y9(t ,a;o) E 
> E 



/(X; o ^)dr + U-(r m ,X^ ) 
/(X^°)dr + ^(r m ,X*°f°) 



An application of Ito's formula yields 



> E 



(r,X^ Xo ) + £<p{r,X t r ' Xo ) + /(JC*" a,0 ))dr 



Taking e = e(t m — to), with e > 0, and dividing both sides by t m — to, we get 



£ > E 



1 



f - (dip 



\dt 



(r,X. 



C<p(r,X^ X0 ) + f(Xt°' X0 ) PW m }d 



Sending to to oo, we end up with 



Therefore we find 



£ > -gj-{to,x ) + Cp(t ,x ) + f(x ). 
dip 

--g^(t ,x ) - Cip(t ,x Q ) - /(x-o) > 0, 



which is the supcrsolution property. The subsolution property is proved analogously. 

□ 
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We end this section providing another definition of viscosity solution to the HJBI 
equation by means of jets, needed later in the proof of the Comparison Theorem 
( Theorem 16. 3p . In the following definition we denote by S(n) the set of symmetric 
matrices of dimension n. 

Definition 5.7. Let V : [0,T] x R™ — >■ R be a lower semicontinuous function, then 
we denote by J 2 ~V(t,x) the parabolic subjet ofV at (t,x) G [0,T) x R™ as the set of 
triples (p, q, M) G R x R" x §(n) such that 

V{s,y) >V(t,x) +p(s-t) + {q,y-x) + \{M(y - x), y - x)+ 
+ o(\s-t\ + \y-x\ 2 ), 

as s — > t (s — > t + , when t = 0) and y — > x. We also introduce the parabolic limiting 
subjet of V at (t, x) G [0, T) x R" : 

J 2 >-V(t,x) = {(p,q,M) G R x K" x S(n) : 3(t n ,x n , Pn ,q n , M n ) G [0,T)x 

x 1" x R x R" x S(n) such that (p n , q n ,M n ) G J 2 -~V(t n , x n ) 
and (t n ,x n , V(t M n ) -4 (i, x, g, M)}. 

When V is an upper semicontinuous function on [0,T] x R n , we define the parabolic 
superjet J 2,+ V(t,x) and the parabolic limiting superjet J 2,+ V(t, x) of V at (t,x) G 
[0, T) x R" fcy 

J 2 ' + F(i,:r) = -J 2 '-(-TO0,x) a«rf J 2 ' + V^,a:) = - J 2 '" (-V)(t, x). 

Then we have the following result, whose standard proof is omitted. 

Lemma 5.8. Let V : [0,T] x K" — > R be a lower (resp., upper) semicontinuous 
function. Then V is a viscosity supersolution (resp., subsolution) to the HJBI equation 
{PP if and only if 

(i) for every (t,x) G [0,T) xR" and (p,q,M) G J 2 --V(t,x) {resp., J 2 -+V(t,x)) we 
have 

max jmin p- (b(x),q) - ±tr [(aa')(x)M\ - f(x),V(t,x) (22) 
-H c sup V(t,x)],V(t,x)-H? ai V(t,x)} >0 (resp., < 0). 

(ii) for every x G R n we have 

max { min [v{T, x) - g(x), V(T, x) - H c sup V(T, x)] , (23) 

V(T, x) - Uf ui V(T,x)} ^ (resp., ^ 0). 



6. Uniqueness 

We prove that the HJBI equation © admits a unique viscosity solution. As 
a consequence, the lower and upper value functions coincide, since they are both 
viscosity solutions to (JSJ). Hence the stochastic differential game has a value. 

Before proving the Comparison Theorem, we need the following two technical 
lemmas. 
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Lemma 6.1. Let V,U : [0,T] x R™ — > R be a viscosity subsolution and a viscosity 
super 'solution to the HJBI equation @), respectively, and suppose that assumption 
(H C:X ) holds true. Let (t,x a ) e [0, T] x R™ be such that 

V(t, x ) ^ H c snp V(i, x ), U(t, .T ) < Hf nl U(t, xo) (24) 

or 

U(i,x )^Hl f U(t,x ). 
Then for every e > there exists x G R n such that 

V(t, x ) - U(t, x ) ^ V(i, x) - U(i, x) + e 

and 

v(t, x) > n c sup v(t, x ), u(t, x) < u? nl u(t, x). 

Proof. Fix e > 0. Wc divide the proof into two steps. 

Step 1. Without loss of generality, we can suppose that (|2"4"|) holds at (t, xo). As a 
matter of fact, suppose that U(t, Xo) ^ Hf nf U(t, xo). Let a € (0, 1) to be chosen later, 
then there exists zo G V for which 

Uf n( U(t, xo) ^ U (£, xo + zo) + x(t, zo) - ae. 

Since V is a subsolution, it satisfies V(t, xq) ^ "H* lf U(i, Xo), therefore 

V(i, x ) -U(i,x ) < V(*, x + zo) - U (i, x Q + z ) + ae. 

Using condition ([5]), taking a sufficiently small, we can show that at (t, xq + zq) we 
have 

U (i, xo + zo) < Hf nf U (i, xo + zq). 
If V(t,xo + zo) > T-Ls np V(t,xo + zo), we take (t,x) := (t,xo + zq). Otherwise at 
(i,xo + zo) condition (f2"4")l holds true. 

Step 2. Suppose that (f2~Xf holds at (t,xo). Let (3 £ (0,1) to be chosen later, then 
there exists yo € U such that 

n c sup V(t, x ) < V(t, xo + y ) - c(t, y ) + (3e. 

Since U is a supersolution, it satisfies U(t,Xo) ^ T-L c snp U(t, xq), therefore 

V(t, xo) - U(t, x ) ^ V(t, x + y )-U (t, x + yo) + 0e. 

Using condition (TJJ, taking (3 sufficiently small, we can show that at {t,xo + yo) we 
have 

V(i, xo + yo) > y.s np V(i, x + yo)- 

If U(t,xo + yo) < T~Lf ni U(t,xo + yo), we take (t,x) := (t,xo + yo)- Otherwise we can 
proceed as in Step 1 and we find zq G V for which 

H* n{ U (i, x + y ) ^ U(t, x + yo + z ) + x(i, z o) ~ fie, 

V(t, x ) - U (t, xo) < V(t, xo+yo + z ) - U (t, x + yo + z Q ) + 2/3e 

and 

U (t, xo + yo + zo) < H* nl U (t, x + yo + z ). 
Then, using condition @, we find (possibly reducing /3) 

V(i, x +y + zo) > Hs Up V(i, x Q + yo + z ). 

Therefore we define (t, x) :— (t, xq + yo + z o). □ 
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Lemma 6.2. Let V, U : [0, T] x M" -> E &e uniformly continuous on [0,T) x E™ and 
suppose that assumption (H CjX ) /io/rfs inte. // (t, x) G [0, T) x R™ is suc/i i/ia£ 

V(i, x) > H c sup V(i, x) and U{i, x) < Hf ni U{i, x), 

then there exists S > for which 

V{t, x) > H c sup V{t, x) and U{t, x) < Hf nf U(t, x), 

when (t,x) G [(i - 6) V 0, i + 8} x B s (x), with i+S <T. 
Proof. Since V(i, x) > Ti.^ up V(i,x), there exists A > such that 

V (t, x) > V{t, x + y)- c{i, y) + A, Vy G U. 

Let e > to be fixed later, then from the uniform continuity of V there exists 
5y G (0, e) such that 

\V(t,x)-V(t',x')\^e, 

when \t-t'\ s$ S v and \x-x'\ sC S v . Let (i, x) G [{i-5 v )V0, (t + Sy) A T) x B Sv (x) 
and y G U, then 

V(t, x) - V(t, x) + V(t, x) > V{i, x + y)- V(t, x + y) + V(t, x + y) 

- c(t, y) + c(t, y) - c(t, y) + A. 

Using the l/2-H61der continuity of c with respect to time, we find that there exists a 
constant C > such that 

V{t, x) > V(t, x + y)- c(t, y)-2e- Cy/e + A. 

Therefore, taking e sufficiently small, we have 

V(t,x) >U c sup V{t,x), (t,x) G [(t— Sy) V 0, (t + 8y) A T) x B Sv (x). 

Analogously, we can prove that there exists Sjj > such that 

U(t,x) <U? n{ U(t,x), (t,x) G [(t-6u)V0,(i+Su)AT) x B Su (x). 

Taking S = minj^y, Su, (T — i)/2} we deduce the thesis. □ 

We are now in a position to prove the Comparison Theorem. 

Theorem 6.3 (Comparison Theorem). Let V and U be a viscosity subsolution and 
a viscosity supersolution to the HJBL equation HJ), respectively. Suppose that as- 
sumptions (Hh.,j), (H/ )9 ) and (H c , x ) hold true and that the functions V and U are 
uniformly continuous on [0, T) x R™. Then V on [0,T] x M". 

Proof. We argue by contradiction, assuming that 

sup (V-U)> 0. 

[0,T]xR™ 

Step 1. Let p > and introduce the functions 

V(t, x) = e pt V(t, x) and U(t, x) = c pt U{t, x), 
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for all (t,x) G [0, T] x R™. Then V (resp., U) is a viscosity subsolution (resp., super- 
solution) to the following equation: 



(25) 



( r r dw ~ ~ i 

max | min y P W - — - CW - f,W - H c sup W\ , 

W - HfrfW} = 0, on [0, T) x R", 
[W(T,x)=g(x), VieR", 

where, for every (t,x) G [0,T] x R™, f(t,x) = c pt f(x), g(x) = c pT g(x), 
H c sup W(t, x) = sup{W(f , x + y) — e"*c(t, y)} 

and 

HLW(t, x) = inf {W(t, x + z)+ c pt X (t, z)}. 

Step 2. Suppose that there exists x G R™ such that V(T,x ) — U(T,xo) > 0. Using 
Lemma 16.11 (we apply this lemma to V and U, expressing the results in terms of V 
and U), we derive the existence of £ G R™ such that 

V(T, x) - U(T, x) > (26) 

and 

V(T, x) > n c snp V(T, £), U(T, x) < H*fi{T, x). 

From the subsolution property of V, we find V(T,x) ^ g(x). Analogously, using the 
supersolution property of U, we have U(T, x) ^ g(x). Therefore V(T, x) — U(T, x) ^ 0, 
a contradiction with (f2"6"|) . 

Step 3. Suppose now that there exists it, x) G [0, T) x R" such that V(t, x) — U(i, x) > 
0. Then, from Lemma [BTTI and Lemma 1531 we deduce the existence of (t, x) G [0, T) x 
R" and 8 > such that 

sup (V -U)^ V(i, x) - U(t, x)>0 

IxBs(x) 

and 

V(t,x) > H c anp V(t,x), U(t,x) < H? nl U(t,x), 

for all (t, x) £ I x Bs(x), where / := [t — 8,t + 5] C [0, T). We can also assume, 
without loss of generality, that 

V{t, x) - U(t, x) < 0, V(i, x) G I x dB s (x). 

Indeed, if this is not the case, define 

V{t,x) = V(t,x) - — ( 1 §4 1 l {lx - £l>S ,2}(x) ~ l), V(M) G [0,T) x R™, 
where 

M := sup (V-U). 

IxBs(x) 
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Since J 2 '+V(t,x) = J 2 -+V(t,x), for all (t,x) £ [0, T) x R", we simply replace V 
with V. 

Step 4- Let (to, xq) £ I X Bg(x) be such that 

sup (V-U) = (V-U)(t o ,x o )>0. (27) 

IxB s (x) 

For every integer n ^ 1, consider the following function 

Q n (t,x,y) = V(t,x) - U(t,y) - (p n (t,x,y), 

with 

tp n (t,x,y) = n\x - y\ 2 + \x- x \ 4 + \t- t \ 2 , 

for every (t, x, y) £ [0, T]xl"x R". For all n there exists (t n , x n ,y n ) £ I x B$(x) x 
Bs(x) attaining the maximum of 0„ on / x Bg(x) x B$(x). Then we have, up to a 
subsequence, (t n , x n , y n ) £ I X Bg(x) x B$(x) and, when n — > oo, 

(i) (t n ,x n ,y n ) (i ,a;o,a;o); 

(ii) ra|x„ - y„| 2 -> 0; 

(iii) 7(i„,a;„) - U(t n ,y n ) -> V"(*o,a:o) - £/(i ,zo)- 

Indeed, up to a subsequence, {t n ,x n ,y n ) — > (t,x,y) € I X Bg(x) x B$(x). Observe 
that, for all n, the following holds true: 

V(t ,x ) - U(t Q ,x Q ) = Q n (t ,x ,x ) ^ 6 n (i„,a; n ,y„). 

Then we find 

V(t ,x ) - U(t ,x ) < liminf ®„(t n ,x n ,y n ) < limsup6 n (i„,x„,y n ) < (28) 

n— J-oc — >■ oc 

< V(i,x) - U(i,y) - liminf n\x n - y n \ 2 - \x - x Q \ 4 - \i- t \ 2 . 

n— f oo 

As a consequence, up to a subsequence, limn-^ n\x n — y„\ 2 < oo, from which we 
deduce x = y. Again from (|28p . using the optimality of (to, xq), we derive (i) and (ii). 
Consequently we get also (iii). Finally, since xq £ B$(x), up to a subsequence, we 
deduce that (t n , x n ,y n ) £ I x Bs(x) x B$(x). 

Step 5. We may apply Ishii's lemma (see Theorem 8.3 in [3]) to the sequence 
{(t n ,x n ,y n )} n : there exist (p£,g£,M n ) £ J 2 >+V(t n , x n ) and (p£, q% , N n ) £ J 2 -~U(t n ,y n ) 
such that 

dip 

P^-PO = -gfi^XnjVn) = 2(t n - t ), 

qy B x (p n (t n , x n , yn) , Q^j — Dy(p n (t n , x n: y n ) 

and 



M„ \ ^ , 1 

^ An + —A 



2 



-JV„ J ^ " 2n n ' 
where A„ = D 2 y ip n (t n , x n , y n ). From the viscosity subsolution property of V" we find 

P V(t n ,x n )-p v - (b(x n ),q v ) - itr[( CT a')(x n )M„] - f(x n ) < 0. 
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Analogously, from the viscosity supersolution property of U we have 

P U{t n ,y n )-pl - (&(»„),$} - \tv[{aa'){ Vn )N n ] - f(y n ) > 0. 

By subtracting the two previous inequalities, we obtain 

p(V(t n ,x n ) - U(t n ,y n )) ^pl-pl + (b(x n ),q%) - (b(y n ),q*)+ (29) 

+ \tx[{aa'){x n )M n ] - \tx{(aa'){y n )N n ]+ 

+ f(x n ) - f(y n )- 

When n — > oo, 

p$-p% = 2(jL n -t )->0, 
Moreover, from the Lipschitzianity of b and (ii), 

lim ((b(x n ),qV)-(b(y n ),q%))=0 

Finally, from the Lipschitzianity of a, (i) and (ii), we get 

lim sup (itv[(aa')(x n )M n } - ±tr[(acr')(y n )N n }) < 0. 

Since, thanks to (iii), the left-hand side of inequality (|2"i?j) goes to p(V(to, xq) — 
U(to,y )), we find V(to,Xo) — U(t ,yo) ^ 0, a contradiction with (|2"T|) . □ 

Thanks to the Comparison Theorem we deduce that the stochastic differential 
game admits a value, as stated in the following corollary. 

Corollary 6.4. Under assumptions (Hb i(T ), (H/, s ) and (H c . x ) the lower and upper 
value functions coincide and the value function of the stochastic differential game is 
given by V(t,x) := V~(t,x) = V + (t,x), for every (t,x) G [0,T) x W l . 

Proof. We know from Proposition 13.21 and Proposition 13.41 that the two value func- 
tions are uniformly continuous on [0,T) x R™. Furthermore, thanks to Theorem 15.61 
both V~ and V + are viscosity solutions to the HJBI equation Hence, from the 
Comparison Theorem, we deduce the thesis. □ 
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